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e  Aviation  Systems  Command  (AVSCOM)  Directorate  for  Procurement  and  Production 
(P&P)  asked  the  Command's  Directorate  for  Plans  and  Analysis  to  review  and  update 
specific  AVSCOM  Cost  Memorandums  concerning  Foreign  Military  Sales  (FMS)  termina¬ 
tion  liability  curves.  This  report  discusses  a  statistical  methodology  offered 
to  update  AVSCOM' s  FMS  termination  liability  schedules  and  contrasts  it  with  the 
technique  employed  in  previous  AVSCOM  studies  on  the  same  subject.  Applying 
both  methods  to  a  common  data  base,  it  is  demonstrated  that  a  linear  estimation 
of  a  logistics  or  exponential  type  curve  using  regression  analysis  produces 
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20.  ABSTRACT  (Continued) 

parameter*  that  are  not  significantly  different  from  the  "equally  likely"  curve 
derived  In  earlier  coat  aemoranduma .  It  la  also  suggested  that  a  Random 
Coefficient  Model  be  seriously  considered  in  future  updates.  r  ■„ 
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FOREWORD 


The  Aviation  Systems  Command's  (AVSCOM)  Directorate  of  Procurement  and 
Production  (P&P)  asked  the  Command's  Directorate  for  Plans  and  Analysis 
to  review  and  update  specific  AVSCOM  Cost  Memorandums  concerning  Foreign 
Military  Sales  (FMS)  termination  liability  curves.  This  report  discus¬ 
ses  the  methodology  used  to  update  AVSCOM' s  FMS  termination  liability 
schedules  and  contrasts  it  with  the  technique  employed  in  previous 
AVSCOM  studies  on  this  same  subject.  Applying  both  methods  to  a  common 
data  base,  it  is  demonstrated  that  a  linear  estimation  of  a  logistics 
or  exponential  type  curve  using  regression  analysis  produces  parameters 
that  are  not  significantly  different  from  the  "equally  likely"  curve 
derived  in  earlier  cost  memorandums. 
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1 .  DATJKCHXNI) 


A.  The  impetus  for  this  report  originates  with  a  ) 976  study  entitled, 
"Cost  of  Terminating  Contracts  Study  (C01OQ61 ) In  that  study,  data 
points  from  five  separate  contracts  were  used  tc  estimate  a  function 
relating  percent  of  total  contract  cost  to  percent  of  contract  completed. 

From  the  derived  relationships,  various  procurement  lead  time  schedules 
for  Foreign  Mi  1 i tary  Sales  (FMS)  liability  payments  were  constructed. 

These  schedules  are  utilized  by  the  Directorate  of  Procurement  and  Production 
in  accordance  with  applicable  sections  of  the  Defense  Acquisition 
Regulations  (DAK). 

D.  One  of  the  expressed  purposes  of  the  OOTOOSI  study  was  to  determine 
whether  the  progress  payments  being  made  by  foreign  military  purchasers 
of  Army  aircraft  were  adequate  to  defray  the  cost  of  contract  termi¬ 
nation.  It  was  found  that  the  schedule  of  payments  included  in  AR-37-60 
did  not  adequately  represent  the  progress  payment  requirements 
xperienced  by  AVSCOM  and  that  a  schedule  based  upon  an  "equally 
likely"  function  would  be  more  representative  of  AVSCXMs  ccrnnodities. 

C.  A  follow-on  study,  Cost  of  Terminating  Contracts  Study  (OOTOOSIl), 
reported  that  the  AVSOCM  "equally  likely"  curve  developed  in  the 
initial  study  was  also  well  suited  for  Array  aircraft  shop-sets.  Eight 
separate  contracts  formed  the  basis  for  (UPDOS 1 1 . 


Subsequent  updates  re-estimated  the  coefficients  of  the  "equally  likely" 
function  using  current  contract  data.  A  summary  of  the  findings  in 
these  earlier  studies  may  be  found  in  Appendix  A. 

D.  This  memorandum  presents  the  methodology  which  will  be  employed  to 
update  0010061 .  Due  to  external  difficulties  with  gathering  new  data,  our 
initial  intention  to  have  applied  the  Random  Coeff icient  Model  to  recent 
contractual  information  proved  to  be  Unpractical.  Thus  in  this  study,  we 
compare  results  from  the  OOTOOS1  methodology  to  that  of  a  selected  statisti¬ 
cal.  model  called  the  Random  Coeff  icient  Model  using  existing  data  found  in 
the  prior  Termination  Liability  studies. 

E.  After  the  new  data  arrives,  we  will  apply  the  Random  Coeff icient 
Model  and  include  the  results  in  a  less  technical  format.  Nonetheless,  the 
results  contained  in  this  report  are  meaningful  in  themselves  and  should  hold 
up  given  the  forthcoming  sanrple. 


II.  Discussion  on  Methodology 


A.  In  this  section,  we  address  same  of  the  issues  that  are  involved  in 
estimating  a  FM3  liability  curve.  The  topics  discussed  are: 

..  Terminology 

2.  Assumptions 

3.  Data 

4.  Functional  form 

5.  Estimation 

6.  Testing 

These  issu  es  are  importint  in  that  the  user  of  the  information-provided  by 
the  estimated  function  can  judge  the  validity  of  the  results,,  given  the  usual 
limitations  imposed  upon  a  study  of  this  type.  -/ 

B.  OCTODSI  defines  termination  liability  payments  to  be  the  amount  that 
represents  incurred  costs  for  90  days  after  payment  plus  the  estimated  amount 
required  to  "clean-up"  the  contract  if  it  were  terminated.  DAE  E-509.5 
defines  incurred  costs  as  follows: 

"(a)  Incurred  costs  are  costs  identified  through  the  use  of  accrual 
method  of  accounting  and  reporting.  As  to  invoices,  incurred  costs 
include  only  invoices  for  (i)  ccmpleted  work  to  which  the  prime 
contractor  has  acquired  title,  (ii)  materials  delivered  (to  which  the 
prime  contractor  has  acquired  title),  (iii)  services  rendered,  (iv)  costs 
billed  under  cost  reimbursement  or  time  and  material  subcontracts  for 
work  to  which  the  prime  contractor  has  acquired  title,  and  (v)  invoices 
for  progress  payments  to  sub-contractors,  which  have  been  paid  or 
a, proved  for  current  payment  in  the  ordinary  course  of  business  (as 
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as  specified  in  the  prime  contract},  all  properly  recorded  on  the  books 
of  the  contractor  and  identified  with  the  contracts.  Costs  incurred  are 
exclusively  costs  of  direct  labor,  direct  mater ial ,  and  direct  services 
identified  with  and  necessary  for  the  performance  of  the  contracts,  and 

I 

also  all  properly  allocable  and  allowable  overhead  (indirect)  costs  \ 

\ 

recorded  on  the  books  of  the  contractor." 

« 

! 

The  OAR  goes  on  to  say  that  special  conditions  apply  for  those  contractors  who 
elected  to  use  a  special  transition  method  provided  in  Cost  Accounting 
Standard  (CAS)  410. 

Clean  up  charges  are  addressed  in  HAR  (7-103.21)  as: 

"the  reasonable  costs  of  settlement,  including  accounting,  legal, 
clerical,  and  other  expenses  reasonably  necessary  for  the  preparation  of 
settlement  claims  and  supporting  data  with  respect  to  the  terminated 
portion  of  the  contract  and  for  the  termination  and  settlement  of 
subcontract  thereunder,  together  with  reasonable  storage,  transportation 
and  other  costs  incurred  in  connection  with  the  protection  of  disposition 
of  property  allocable  to  thi  'ntract." 

Since  part  of  tho  settlenent  charges  are  not  incurred  unless  the  contract 
is  terminated,  the  data  sources  (CL)  Fort.:  1195)  used  in  the  previous  studies  do 
not  include  them.  Clean  up  costs,  however,  appear  to  be  relatively  small  com¬ 
pared  to  the  total  contract  dollar  amount,  and  so  need  not  cause  too  much 
concern.  It  is  necessary,  though,  to  determine  as  close  as  possible  the 
amount  of  costs  due  to  charges  other  than  termination  preparations.  Some 
of  these  charges  such  as  subcontract  settlements  and  work  in  progress  costs 
may  be  difficult  to  estimate.  The  Army  Logistic  Management  Center  (ALMC), 
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for  example,  agrees  that  a  settlement  should  not  only  compensate  the  con-* 
tractor  for  work  completed  anc  for  preparations  to  terminate  the  contract 
but: 

"The  application  of  standards  of  business  judgment  as  distinqulsed 
from  strict  accounting  principles,  is  the  heart  of  a  settlement, 

The  primary  objective  is  to  negotiate  a  settlonent  by  agrecnent." 

(sec  references,  ALMC). 

C.  This  implies  that  overall  termination  costs  depend  in  part  on  rela¬ 
tive  bargaining  strength  of  the  participants;  the  measure  of  which  being 
subjective.  That  is,  there  Is  no  straightforward  way  to  know  the  outcome 

in  advance.  Given  that  this  Is  true,  we  might  ask  how  the  clean  up  costs  are 
calculated, 

D.  OOTQU6I  estimated  these  termination  costs  by  assuming  that  reported 
costs  (and  therefore  subject  to  termination  reimbursement)  lag  incurrred 
costs  according  to  a  certain  formula.  The  formula  stated  that  the  lag 
Increases  linearly  until  it  reaches  90  days  midway  through  the  contract 
and  ronains  constant  thereafter. 

H.  AK  37-60  also  attempts  to  reflect  potential  normal  termination  charges 
by  including  in  the  accrued  expenditures  those  costs  to  be  incurred  during  the 

runoinder  of  the  currant  quarlor. 

j 

i  V.  The  most  recant  update  to  CDItDSl  did  not  include  any  lag  adjustments, 
'reflecting  a  payment  schedule  rather  than  a  termination  liability  schedule. 

A  payment  sohedulc  is  a  sequence  of  payments  derived  from  a  payment  curve. 

The  payment  curve  rep.esents  the  emulative  sun  of  the  contractor's  progress 
payment,  the  incrorwntal  portion  of  non-recurring  costs,  cost  of  Defense  ser¬ 
vices,  and  adninlslrat ive  charges  as  a  function  of  contract  completion. 


G.  A  termination  liability  schedule  likewise  is  a  derived  listing  of 
payments.lt,  however,  is  calculated  from  a  termination  liability  curve.  The 
termination  liability  curve  represents  the  "bail  out”  costs  incurred  when  the 
FIVE  customer  announces  termination  of  the  FM5  case;  to  include  all  accrued 
direct  and  indirect  costs, and  profits  of  prime  and  subcontracts  not  covered  ^ 
by  contractor  papnents  or  holdback, plus  any  penalty  contract  cancellation 
charges  for  which  DOD  would  be  liable.  The  termination  liability  curve 
represents  a  function  relating  termination  liability  costs  to  percent  of 
contract  completed. 

II.  In  this  study  the  curve  that  is  estimated  is  the  termination  liability 
curve  showing  emulative  payment  costs  as  related  to  percent  of  contract 
completed.  Comparisons  with  DOD  payment  curves  and  the  AV9CEM  curves  esti¬ 
mated  in  previous  studies  are  made  after  properly  adjusting  the  data.  These 
adjustments  are  noted  where  appropriate. 

I.  Some  assumptions  that  pertain  to  the  present  study  differ 
dramatically  from  those  cited  in  OQTOQSl.  First,  the  curve  derived  in 
OOmXSI  (and  subsequent  updates)  is  deterministic,  a  termination  liability 
curve  is  fit  assuning  a  function  of  the  form  y  =  A(l-e”^x)  and  solving  for 
each  parameter  using  two  known  points;  i.e.,  (L00/00)  and  (.5,y)  where  y  is 
the  midpoint  of  the  ordinate  for  the  sanple  of  contracts  selected.  This 
study,  on  the  other  hand,  assumes  a  stochastic  relationship  between  percent  of 
total  cost  and  percent  of  contract  canplete.  We  then  fit  a  curve  minimi¬ 
zing  the  variance  about  the  fitted  curve  using  the  sanple  data.  All  the 
usu  al  assumptions  for  the  linear  least  squares  estimator  are  made,  i.e., 

1.  the  error  tenro  have  zero  mean 

2.  the  error  terms  have  a  ccntmun  variance 

3.  the  error  terms  are  independent 


4.  the  error  terms  are  independent  of  the  independent  variable. 

J.  Since  the  independent  variable  ranges  over  all  the  possible  values, 
i.e.,  0  to  100  percent,  the  variance  error  is  always  a  min  inrun  for  the 

true  model.  To  see  this,  note  that: 

V(b)  =  02  _  ,  . 

E(X-xr 

Except  for  asse  t  use  charges,  all  costs  not  included  in  progress  payments 
request  (CD  Form  1195)  are  Imp  sun  charges  over  and  above  total  contract 
cost  and  are  assumed  to  be  time  phased,  in  the  same  way  as  the  progress 
payments.  The  charges  are  for  Government  Furnished  Equipment,  accessorial 
charges,  adninistrat ive  charges,  incremental  non-recurring  costs  and  cost  of 
Defense  services.  Asset  use  charges  are  added  in  at  4%  of  the  progress  pay¬ 
ment. 

K.  Though  inspection  of  the  data,  the  functions  estimated  in  previous 
studies  were  assumed  to  have  the  form  y  =  A[(-  exp  -  BX2)1.  A  poly¬ 
nomial  regression  was  also  attempted,  but  reportedly  did  not  fit  well.  In 
addition,  one  study  tried  y  =  A£l  -  exp  -  HX^J  on  data  frcmAR  37-60 

and  reported  a  good  fit.  Constraining  the  equation  to  fit  through  the  point 
(100,100),  the  parameters  were  estimated  by  using  the  mean  ordinate  value  at 
fifty  percent  completion  of  the  contracts. 

L.  In  this  study,  we  transform  the  data  assuming  a  logistic  curve 
to  represent  the  relationship  between  percent  of  contract  conpletion  and 
liability.  By  regressing  the  transformed  dependent  variable  (regressand)  on 
the  independent  variable,  we  are  able  to  make  certain  statistical  inferences 
about  the  data  which  can  not  be  done  using  the  technique  applied  in  the  pre¬ 
vious  studies.  The  form  of  the  logistic  function  is 

y  =  a 

l  exp ( -Do  -  BjX) 
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where  A  is  set  equal  to  1. 

M.  This  equation  is  intrinsically  linear  and  capable  of  being  estimated 

i 

using  Ordinary  Least  Squares  (OLS). 

Set  y*=  a  +  b  x  u 

where  y*  =  In  Y 
1-Y 

then  lny  =  a+bx+u 
Fy 


and 


1-y  =  exp  a  +  b  x  +  u 
y  =  (exp  a  +  b  x  +  u)  +  1 

Y  =  _ 1 _ 

exp'*  'b  X  .  I 


N.  We  also  apply  least  squares  to  the  nor- linear  equations  estimated  in 
COItESI  and  its  updates  using  the  maximun  likelihood  function: 


P  (O.O2)  *  (2  d2)  n/2  e"s  (0,)/2&2 

where  S  (O')  is  the  error  sun  of  squares.  We  also  re-estimate  the  logistic 
equation  £1 . l) ,  using  non-linear  least  squares  assiming  no  restriction  on 
the  parameter  A. 

O.  Since  the  data  is  a  time  series  across  various  contracts,  a  test  was 
performed  to  determine  whether  any  aggregation  bias  was  introduced  by  pooling 
the  data.  A  procedure  was  followed  to  correct  this  bias  under  the  randan 
coefficient  model  (HCM): 

*iv  *  Biv  xi«*  uiv  1  1  v  ■  *•  — •T 

where  i  is  the  contract  and  v  is  the  observation. 

P.  After  the  functional  forms  were  identified,  we  noticed  that  the  exponen¬ 
tial  equation  in  GUILDS  I  is  a  growth  model  with  a  proportional  growth  rate. 
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If  we  define  exp  (-B0  -  BjX)  =  A/y  -1 
we  get 

dy  *  -AB.  exp  (“Bq  -BiX)  =  -ABi  (A/y  -  _1) 

**  n  +  expT-B0-BiX)2  A^y* 

=  Bi  Y  (A-Y)  . 

“  — X - 

Thus,  our  choice  of  function  will  assime  a  nonconstant  rate  of  growth  regard¬ 
less  of  the  explicit  form,  i.e.,  logisitic  or  exponential. 

Q.  The  technique  used  to  estimate  the  function,  however,  is  affected  by 
the  functional  form  of  the  estimate.  A  logistic  Curve,  as  noted  above,  can 
be  estimated  using  OLS.  If  the  fit  is  good  then  strong  inferences  can  be  made 
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about  the  data  and  tests  performed  to  enhance  those  inferences.  The  exponen¬ 
tial  form,  on  the  other  hand,  is  intrinsically  non-linear  and  ©oc  mist  use 
non-linear  estimation  techniques  to  find  estimates  for  the  parameters.  Con¬ 
sequently  tests  and  inferences  are  subject  to  certain  restrictions  that  iray 
not  hold  in  practice.  We  have  kept  in  mind, though,  that  the  exponential  j 
equation  does  capture  nicely  the  fact  that  the  points  (0,0)  and  (I00,100)t 
are  necessarily  on  the  curve.  We  recognize,  however,  that  a  non-zero  intercept 
term  may  only  reflect  the  sanple  size  and  would  approach  zero  as  the  sanple 
size  increases. 

R.  The  test  which  we  apply  are  basically  one  of  three  types.  The  first  is 
the  usual  test  that  indicates  goodness  of  fit.  The  second  type  is  to  deter¬ 
mine  whether  the  parameters  using  CGTOUS1  data  are  significantly  different 
over  the  contracts  in  the  sanple  data;  which,  in  turn,  determines  whether 
we  can  aggregate  the  data  and  estimate  the  population  parameters  with  a 
single  equation.  Lastly,  after  estimating  the  function  using  the  latest 
contract  data,  we  will  test  whether  or  not  the  estimated  parameters  are 
significantly  different  from  those  estimated  using  CX7DG0SI  data. 


III.  APPLICATION 


A.  The  initial  phase  of  this  study  consists  of  a  statistical  analysis 
of  OGHP0061  data  in  order  to  determine  the  appropriate  functional  form  of  the 

•  termination  liability  curve.  Inspection  of  the  data  appeared  to  have  an  S 
|  shape  when  plotted  y  on  x.  Thus  a  logistic  curve  of  the  form: 

;  y  =  l/ll  ♦  exp  B0  ♦  Bj  Xol 

was  hypothesized  since  this  particular  logistic  curve  can  be  fitted  using 
OLS. 

B.  Regressing  the  dependent  variable  on  the  independent  variable  for  each 
contract  separately  (assuming  the  logistic  curve);  we  found  good  r2  fits 

for  each  of  the  equations  (Appendix  B).  However,  the  Durbin  Watson  statistics 
indicated  that  this  is  largely  due  to  the  autocorrelation  present  and  not 
because  of  the  linear  relationship  between  the  dependent  and  independent 
variables.  Table  2  shows  the  results  using  CLS,  first  differencing,  and 
quasi  differencing.  The  differencing  renoves  the  autocorrelation  in  order 
to  show  the  true  relationship  between  cost  and  time  as  defined  in  this  study. 
As  one  can  see  fron  Table  2  the  results  are  not  very  premising. 

C.  In  addition,  because  the  available  data  contained  both  cross  sectional 

i 

\  and  time  series  information,  tests  are  required  to  determine  whether  pooling 

j 

S  is  appropriate. 

v 

i 

D.  Although  we  expect  that  because  of  autocorrelation  the  variance  due  to 
the  regression  is  understated,  examination  of  the  standard  error  <..d 

the  closeness  of  the  estimates,  thenselves,  is  convincing  in  that  we  can  not 
reject  the  hypothesis  that  our  M,  estimate  is  equal  to  the  estimate  in 
OOTCC6I . 
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£.  Since  b  in  (X7ICQSI  equals  .000461  and  the  M>  estimate  (b) 
equals  .000477,  we  want  to  test 

b  =  b  null  hypothesis 
b  4  b  alternate  hypothesis. 

The  M,  b  standard  error  is  .000016. 

P.  Using  the  rule  of  thunb  that  if  t  is  greater  than  2  t t0|o°  =  2.6 
*05, ~  1.981, we  will  reject  the  Null  hypothesis  when  we  see  that  the  | 

i 

standard  error  exceeds 

S*  =  /b  -  b/  t  2 

--  /. 000477  -  .000461/  -  2 

=  .000008 

which  is  almost  60  times  less  than  the  reported  ML  standard  error. 

Similarly,  we  can  test  whether  the  parameter  estimated  for  the  AVSOCM  curve 
differs  significantly  from  the  AR  37-60  parameter  estimate. 

Putting 

*05,208  =  b  -  14.94798 

Ob 

=  8.0801  •  14.94798 

2.5469 

=  2.696 

G.  We  do  not  accept  the  null  hypothesis  that  the  parameter  for  the  AVSOCM 
Termination  liability  curve  equals  the  AH  37-60  curve  parameter. 

H.  The  reason  we  do  not  test  the  AR  37-60  parameters  is  that  the  data 
is  not  a  sanple  but  an  estimate  presimably  calculated  f~om  information  on  a 
wide  spectrun  of  DGD  contracts. 


[.  The  hypothesis  needed  to  pool  the  data  is: 


Ho  Bj  =  B2  =  B3  =  B4  =  B5 

The  appropriate  test  is  the  F  test  where: 

F  =  (KRSS  -  URSS) /  K-l 

URSS/ni  +  n2  ♦  n3  +  04  +  ns  +  (nK  -  n) 
and 

n  =  nurber  of  equations 

K  =  nuTtoer  of  independent  variables 

HRSS  =  residual  sun  of  squares  for  the  entire  data  set 

URSS  =  residual  sun  of  squares  of  each  equation  sunned 

using  the  equations  corrected  for  autocorrelation,  we  have 

URSS  =  (.391  •  54)  ♦  (.725  •  42)  ♦  (1.08  •  25)  ♦  (.192  •  46)  + 

(.775  •  16)]  =  99.80 

HRSS  =  83.698  X  197  =  16651 

K  =  1 

n  =  5 

F  =  16651  -  99.812  ^  F* 

99.8/199/2 

We  obviously  reject  the  null  hypothesis. 


J.  As  an  alternative  to  pooling  the  data  under  the  assumption  of  stable 
parameters,  we  considered  the  hypothesis  that  the  coefficients  are  random 
variables  and  used  the  Random  Coef f ieient  Model  to  estimate  the  population 
parameter  b.  The  calculations  are  shown  in  appendix  C.  Noting  that  the 
equation  is: 

cost  =  _ _ _ 1 _ 

1  ♦  exp  (2.62  -  8.081  Time)  we 

have  found  that  the  coefficient  b  is  distributed  across  contracts  with  a 
mean  equal  to  -8.0807  and  variance  equal  to  6.487.  The  standard  error  equals 
2.468. 

K.  The  data  fron  OOTOOSI  was  read  off  curves  presented  in  the  OOTOOSI 
Cost  Memorandums.  Consequently,  there  is  strong  reason  to  suspect  the 
presence  of  errors  in  the  predicator  variable.  This  means  that  the  dS 
estimator  is  biased  such  that  E(b)  =  b/  (1  +  p) 

where  p  is  the  ratio  of  the  spread  in  the  errors  of  the  independent 
variable  to  the  spread  in  the  errors  of  the  dependent  variable. 

L.  Due  to  the  presence  of  the  above  errors,  the  primary  objective  of  this 
study  is  to  prepare  a  methodology  for  data  that  is  to  be  collected  on  con¬ 
tracts  which  are  let  after  1980.  We  expect,  however,  that  the  following 
findings  will  hold  true: 
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).  Applying  Ordinary  Least  Squares  or  the  Maximun  Likelihood  Method 

2 

to  the  raw  data  exhibits  a  high  R  due  to  the  autocorrelation  present. 

2.  The  methodology  used  in  QOT006I  gives  parameter  estimates  that  are  not 
significantly  different  from  the  Max  inrun  Like  1  i  hood  estimates  unadjusted  for 
autocorrelation. 

3.  The  parameter  estimates  using  OLS  on  the  data  adjusted  for  autocor- 
correlation  are  quite  a  bit  different  from  the  estimates  on  the  unadjusted 
data. 

4.  The  AVSOCM  Terminat ion  Liabi 1 i ty  Curve  is  significantly  different 

from  the  curve  given  in  AR  37-60.  Thus,  it  is  reconmended  that  a  curve  based 
upon  AVSOCM  contracts  be  enployed  in  determining  FIVE  liability. 

5.  The  Randan  Coefficient  Model  using  data  adjusted  for  autocorrelation 
has  as  much  explanatory  power  as  OLS,  M>,  and  the  001006 1  techniques  even 
without  adjustment  for  correlation. 


IV.  RESULTS 


Our  conclusion,  although  adnittedly  based  upon  less  than  desirable 
data,  are  as  follows: 

A.  The  OOIUOSI  equation  as  depicted  in  Graph  3  lies  sanewhat  below 
the  RGVI  function.  Tl^is  indicates  that  in  the  eyes  of  Foreign  customers  the 
present  equation  would  be  preferable  to  the  estimated  RCM  equation.  However 
fromAVSCEM's  standpoint  it  would  appear  wise  to  gather  new  data  and  deter¬ 
mine  whether  or  not  the  Amny  should  require  additional  funds  from  Foreign 
customers. 

B,  It  is  recaimendcd  that  the  present  Termination  Liability  Curve  be 
followed  until  a  new  sample  becomes  available.  Then  a  Random  Coefficient 
Model  should  be  applied  to  the  data  and  compared  with  other  alternative 
statistical  techniques  as  shown  in  this  report 


FOREIGN  MILITARY 


TERMINATION  LIABILITY  CURVES 


FOREIGN  MILITARY 


TERMINATION  LIABILITY  CURVES 


FOREIGN  MILITARY  SALES 
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TERMINATION  LIABILITY  CURVES 


TABLE  1 


FUNCTIONAL  FORMS  -  COTCOSI  DATA 


Y1  -  All  -  exp  -  BXi 2 )  , 

-  99.04  |1  -  exp  -  0.0005  X|1 

0.42)  (  .000032) 


*1 


(1.89) 


(.000001) 


-  1/  ll  ♦  exp  B0  ♦  X0  ) 


1/  11  ♦  exp'3. 19  -  8.14  X0  J 
(.144)  (.359) 


V!  "  A  ll  -  exp  BXi 
Not  Significant 


-  1/(1  ♦  exp  Bq  ♦  Bi  XD  j 

1/  ll  +  exp  2.616  -  8.082  XQ j 
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.88 


e*P  Bc  +  Bj 

*  exp  3.50  -  9.74  X0 1 

1  (.200)  (6.78) 

R2  - 

exp  B0  ♦  Bj  Xo] 

exp  3.73  -  9.225  X^] 

(114)  (.284) 

R2  - 

exp  B0  ♦  Bjt  X0  | 

exp  3.88  -  9.65  X<jj 

R2  - 

exp  BX!3  | 

1  -  exp  .00002  Xi3  ) 

R2  - 

.88 


.88 


.86 


.87 


.87 


.88 


Vw*«.-V  N'.V-.V  u'.li-V.Ji'Aiii'UiW.l.Wii.'A'.  I 


(Eq  A) 


(Eq  B) 


(Eq  C) 


(Eq  D) 


(Eq  E) 


(F.q  F) 


(Eq  G) 
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w 


S  «V  ii»I 


-i*.  N  *. 


*%*  ■-  ‘  •»*  -%"  '  e 


(Eq  H) 


Equations  A,  B,  E,  F,  and  C  were  estimated  using  non-linear  regression 
Equation  C  is  a  linear  transformation  of  logistic  curve 
Equation  D  is  adjusted  using  random  coefficient  model  of  Equation  C. 
^Equation  H  is  the  Random  coefficient  model  adjusted  for  autocorrelation. 

i 

jx1  -  100  *  x0 

*  Values  in  parenthesis  are  standard  errors. 
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TABLE  2 


CORRECTING  FOR  AUTOCORRELATION 


CONTRACT 

COEFFICIENTS 

V 

62 

DW 

CONSTANT 

B 

1 

} 

OLS 

-4.401 

9.470 

.99 

139.4 

.57 

f 

,  in 

first  differenced 

-0.015 

11.687 

.60 

.97 

2.30 

in 

quasi  differenced 

-0.115 

10.413 

.51 

.81 

2.19 

U2 

OLS 

-4.183 

12.889 

.97 

171.8 

.226 

92 

first  differenced 

0.068 

8.125 

.08 

.81 

1.31 

in 

quasi  differenced 

0.082 

6.163 

.04 

.02 

1.29 

#3 

OLS 

-4.544 

11.900 

.99 

128.8 

.75 

#3 

first  differenced 

0.069 

9.768 

.  13 

1.47 

2.03 

in 

quasi  differenced 

-1.82 

11.924 

.94 

19.4 

1.58 

#4 

OLS 

-2.952 

7.500 

.98 

49.72 

.26 

#4 

first  differenced 

0.052 

3.268 

.  12 

.211 

1.55 

i  4 

i 

l 

quasi  differenced 

-0.163 

6.195 

.67 

.58 

2.08 

1 

#  5 

OLS 

-3.112 

6.460 

.96 

29.55 

1.10 

#5 

first  differenced 

.069 

4.517 

.08 

1.23 

2.73 

‘  #5 

quasi  differenced 

-1.617 

5.837 

.89 

7.27 

2.33 

I 

\ 

l 


\ 

\ 


\ 

i 


t 

< 


FOOTNOTES: 

*  Numbers  in  parentheses  are  standard  errors 

Equation  2  is  not  significant 
**  See  Appendix  B 
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APPENDIX  A 

Summary  of  Previous  Findings 


Equat Ions 


Tech  Report  # 


Y  »  101  |1  -  exp  -0.00046152  X- | 


COTCOS  I 


Y  ■»  103  (1  -  exp  -0.00035362  X* ) 


COTCOS  II 


.iq 1  Y  ■=  109.96  |1  -  exp  -0.00024015  X2 ) 


CM  81-6 


Eq4  Y  -  103.08  II  -  exp  -0.00035100  X1) 


CM  84-2 


Footnotes : 


Kq*  represents  Aviation  end  items  and  includes  Lag. 

Eq?  represents  shop-sets  and  includes  Lag. 

Kq^  represents  update  of  Eql  using  recent  contract  data. 

Eq^*  represents  update  of  Eq^  but  does  not  have  a  lag  adjustment. 
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APPENDIX  C 

Random  Coefficient  Model  Calculations 


I.  COTCOSI  Data. 

A.  Assuming  chat  the  percent  of  total  copt  for  any  contract  is  a  function 
of  time  such  that  the  slope  parameter  is  distributed  with  mean  B  and  var 
(wi)  where  i  indicates  some  contract,  the  population  parameters  can  be 
estimated  using  the  regression  model: 


y.  .  -  B  X.  .  +  W.  .  i  -  1  ,2, - N 

LJ  11  11  .  ,  ’ 

j  ■  1,2, - T 


where 


W.  .  -  U. .  *  V;  X. . 


B.  If  we  let  var  (vx)  equal  d  and  toe  expected  value  equal  zero  then 

var(W..)  -  O' 2  2_  i 

ij  2  *  d  X.J.  Thus  we  want 

to  find  B,  d  ,  and  0\2,  This  model  is  called  the  random  coefficient 


regression  model  (RCR).  Swamy  suggested  using  generalized  least  squares 
11  “  tl^l  (0.2  j  ♦  d2  x.  x’)_1  x)  t(  X.  ’  (Oil  l  ♦  d2  Xi 


»  1 


D.  For  the  five  contracts  used  in  Che  COTCOSI  Study  we  gett 


O 


Ni 

# 

PROB  >  F 

R‘ 

46 

175 

A 

y=l 

- 

-4.183 

(.1102) 

+12.889 

(.3129) 

TIME 

.0001 

.9741 

2.8 

200 

A 

y2 

s 

-4.544 
( . 1019) 

+11.900 

(.2759) 

TIME 

.0001 

.9857 

49 

081 

A 

y3 

K 

-  2.95 
(.0625) 

+  7.50 
(.1556) 

TIME 

.0001 

.9797 

57 

123 

A 

y4 

-4.401 
(  .0512) 

+  9.47 
(  .1152) 

TIME 

.0001 

.9797 

19 

0087 

A 

y5 

S 

-3.113 

+6.460 

TIME 

.0001 

.9569 

Note:  The  numbers  in  parenthesis  are  standard  errors. 


*  2  „ 

0"! 

4.344012 

+- 

46  " 

.094435 

i  2 

a  2  “ 

1 .775739 

• 

28  * 

.0634193 

et  2  , 

<y3 

.985916 

-4- 

49  ■ 

.0201207 

o42  * 

1 .  125299 

• 

57  ■ 

.0197421 

e52  - 

1.203074 

• 

19  - 

.0633197 

40 


where  is  the  regression  coefficient  using  OLS. 

2  2 

C.  For  estimates  of  the  parameters  d  and  fr-1, 


we  have 


OTi.2  -  1/TlU.*  U.! 


d2  -  1  / N  £  B.2  -  (l/N  £  B.)2  -  VarCL) 


I 

ft 

NV- 


41 


T 


£  Bi  -  12.888788  +  11.900510  ♦  7.499920  +  9.469604+ 

*  48.219046 

* 

\ 

1 
* 

£Bi2  -  5  -  99.079938 

d*  -  99.079938  -  93.003056  -  6.0963241 


9.6438092 


and 


Bi2  -  93.003056 


£Bi2  -  166.12086  +  141.62214  +  56.2488  +  89.6734  ♦ 

-  495.39969 


Because 

1/ld2  +  0ri2/X1  *Xt  | 

wt  * - 

N  ,  , 

£  i/l<r  +  cr  /  x  x  i 

j-i  j  j  j 


tTi2 

Xi) 

m  var 

(Bi 

) 

<*l' 

Xj) 

m 

.098728 

- 

.0979271 

1.0081789 

1*2 

X2) 

m 

.068298 

- 

.0761357 

.8970561 

(X3’ 

x3) 

m 

.020977 

T 

.0242132 

.8663447 

(X*' 

*4>, 

m 

.020460 

T 

.013248 

1.54438 

(X5' 

X5) 

m 

.070769 

- 

.1041831 

.6792755 

6.460224 


41.734494 


42 


O'lZ/Xi1  Xi  - 

.094435  -  1.0081789  - 

.0936689 

<y22/X2*  x2  - 

.0634193  t  .8970561  - 

.0706971 

O32/X34  x3  ■ 

.0201207  t  .8663447 

.0232248 

jX42/X4l  X4  * 

.0197421  -  1.54438  • 

.0127832 

|l52/X5»  X5  - 

.0633197  *  .6792755  - 

.0932165 

t[d2  ♦  ffj2/(Xjl  Xj)J  _1  “  (.093689  +  6.0963241)"1 


♦ 

(.0706971 

♦ 

6.0963241 )"1 

+ 

(.0232248 

♦ 

6.0963241 )_1 

♦ 

(.0127832 

6.0963241 )_1 

♦ 

(.0932165 

♦ 

6.0963241  r1 

-  .8123676 

we  get 


W1 

- 

(1/(6.0963241 

♦ 

.0936689))/. 8123676 

m 

.1988645 

w2 

m 

(1/(6.0963241 

♦ 

.0906971))/. 8123676 

m 

.1996053 

W3 

m 

(1/(6.0963241 

♦ 

.0232248))/. 8123676 

m 

.2011537 

w4 

m 

(1/(6.0963241 

♦ 

.0127832))/. 8123676 

m 

.2014975 

w5 

m 

(1/(6.0963241 

♦ 

.0932165))/. 8123676 

- 

.198879 

Thus, 

B  -  2.5631224  ♦  2.3754049  +  1.5086367  ♦  1.9081015  ♦  1.2913206 


9.6465861 


E.  The  Random  Coefficient  Model  applied  to  equations  corrected  for 


autocorrelation  gives 


Yj  " 

-4 

♦ 

<M 

Os 

r-* 

• 

10.413  X 

.0072 

*2  “ 

20.6  + 

6.163  X 

.017 

y3  - 

- 

4.516  ♦ 

11.924  X 

.043 

*4  “ 

- 

2.18  * 

6.195  X 

.004 

*5  * 

-3 

.431  ♦ 

5.837  X 

.048 

- 

40. 

532 

®i  ‘ 

8.106  Di2  -  65.713 

m 

361 

.04 

*>  ? 

B  » 

72.2 

-  72 

.2 

-  65. 

713  -  6.487 

f  16.  -  .405 

xi'xi 

m 

.0072 

-  1.69 

.0011 

X2’x2 

m 

.017 

-  9.36 

.00088 

x3’x3 

- 

.043 

-  .336 

.1279 

x^'x^ 

- 

.004 

-  .409 

.0098 

x5'x5 

at 

.048 

.25 

.  192 

s  r< 


m 

((.405 

♦ 

(.0072))"1 

+ 

1 ( .405 

+ 

(.017))"1 

♦ 

((.405 

♦ 

(.043))'1 

♦ 

((.405 

♦ 

(.004))_i 

♦ 

((.405 

* 

( .048) )_1 

aa 

11.680 

46 


a  « ,j  k.  =<*i  i.%«. 


».  «  u  *  •  f  _  *i  «  a  *  n  „  a  «  •.  « 


*  m  *.eUR.  a  * 


WX  -  .207 

W2  ■  .203 

W3  »  .191 

WA  -  .  209 

W5  -  .189 

B  -  10.413  (.207)  ♦  6.163  (.203)  ♦  11.924  (.191) 

+  6.195  (.209  ♦  5.837  (.189) 

=  8.0807 

^  -  .346871  -  8.0807  *  .3666734 

-  -2.6161067 


The  equation  then  corrected  for  autocorrelation  is 


-2.6161067 


8.0898 


TIME 


cost  ■  _ ) _ 

1  ♦  cap  2.616  -  8.081  TIME 
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APPENDIX  E 

Summary  of  AR  37-60  Equations 


.  — f-1  - 

Method 

1  ?2 

Cramers 

\ 

CM  83-28  -  ^  - 

yi“ 

103.4(1  - 

exp  -  .0000034 11989Xp  -f 

i 

OLS 

Payment  Schedule 

y  * 

1/1  +  exp 

(3.957439  -  9.257841X)  .'94 

OI.S 

Liability  Schedule 

y  *• 

1/1  +  exp 

(5.744213  -  9.694010X)  .97 

OLS 

Corrected  Liability  Schedule 

y  “ 

1/1  +  exp 

(10.757  -  14 . 94798X)  .94 

ML 

Liability  Schedule 

V 

112.258  (1  -  exp  -  .000196378X]2)  .86 

ML 

Liability  Schedule 

V 

91.869  (1 

3 

-  exp  -  .00000  443551  X^.88 

*1 

»  100  *  X 

Y  i 

=  100  *  X 

' 

GLOSSARY 


Accessorial  costs  -  Chargee  assessed  for  certain  expenses  for  issues,  sales,  I 
and  transfer  of  materiel.  The  charges  are  for  packing,  crating,  handling, 
and  transportation,  port  loading  and  unloading,  positioning  costs,  and  other  i 
expenses  incident  to  the  FMS  sale  but  not  included  in  the  standard  price  or 
contract  coat. 

Administrative  charges  -  Charges  for  Quality  Assurance  and  Inspection,  con¬ 
tract  administration,  audits  and  other  general  management  and  administrative 
expenses. 

Aggregation  Bias  -  Bias  in  parameter  estimate  due  to  combining  micro  data. 

Asset  Use  Charge  -  Charges  assessed  for  the  use  of  Government  owned  property 
and  plant  equipment. 

Autocorrelation  -  T.i  disturbance  term  in  the  regression  model  is  dependent 
on  the  value  of  the  disturbance  term  in  an  earlier  period. 

Contractor  holdback  -  Percent  of  progress  payment  withheld.  Contractor 
payment  plus  holdback  equals  the  progress  payment. 

Dependable  Undertaking  -  A  firm  conanitment  made  by  a  foreign  Government 
or  international  organisation  t-  pay  the  full  coat  of  and  to  ensure  the  US 
Government  against  any  loaa  on  a  contract  for  new  production  or  the  perfor¬ 
mance  of  defense  services. 

Durbin  Watson  Statistic  -  Statistic  used  to  indicate  the  degree  of  autocor¬ 
relation  among  the  error  terms. 

! 

F  Test  -  Statistical  test  that  uses  the  F  distribution  named  after  Sir  R.  A. 

K isher  . 

First  Differencing  -  Procedure  that  is  used  to  adjust  data  so  that  first  order 
correlation  is  eliminated. 
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FMS  Case  -  A  DD  Form  1513  "United  States  Department  of  Defense  Order  and 
Acceptance,"  which  has  been  accepted  by  a  foreign  country. 

Logistic  Curve  ~  S-ahaped  curve  that  is  often  used  in  growth  models. 

Maximum  Likelihood  Method  -  Statistical  prccedure  that  estimates  population 
parameters  which  would  give  highest  probability  of  generating  the  sample 
observed. 

Ordinary  Least  Squares  -  Regression  technique  that  fits  a  line  to  data 
points  in  order  to  show  the  relatii  .up  between  a  dependent  variable  and  one 
or  more  independent  variables. 

Progress  Payments  -  Payments  to  a  contractor  based  upon  his  accomplishments 
to  date. 

Quasi  differencing  -  Procedure  that  is  used  to  eliminate  autocorrelation  from 
regression  error  terms. 

Random  Coefficient  Model  -  Regression  model  that  assumes  the  beta  coeffi¬ 
cients  are  random  variables. 

Standard  Error  -  A  statistic  that  indicates  the  spread  due  to  sampling  error 
about  the  parameter  estimate. 


